Display of Supplementary Information on a Graphical User Interface

ABSTRACT

Disclosed are method and apparatus for displaying supplementary information on a graphical user interface. A request for supplementary information is received. The supplementary information is retrieved and displayed in a reserved display field in a graphical user interface. The reserved display field may be configured by a user to adapt to specific applications, but remains stationary throughout the user session. The reserved display field does not obstruct any other display fields in the graphical user interface. A request for supplementary information may be generated by using a mouse to first position a cursor over an active display element. A request for supplementary information associated with the active display element may be generated by clicking the mouse, or by holding the cursor stationary for a time interval greater than a threshold dwell time.

This application is a continuation of application Ser. No. 14/326,655filed Jul. 9, 2014, which is a continuation of application Ser. No.13/922,714 filed Jun. 20, 2013, and issued as U.S. Pat. No. 8,806,365 onAug. 12, 2014, which is a continuation of application Ser. No.12/277,630, filed Nov. 25, 2008, and issued as U.S. Pat. No. 8,490,011on Jul. 16, 2013, which claims the benefit of U.S. ProvisionalApplication No. 61/127,633, filed May 14, 2008, all of which are herebyincorporated by reference in their entirety.

BACKGROUND

The present invention relates generally to display of information on agraphical user interface, and more particularly to display ofsupplementary information.

A graphical user interface (GUI) is an effective mechanism for a user toprovide input to and receive output from software applications. Assoftware applications have grown increasingly more complex, GUIs havecorrespondingly grown increasingly more complex. Particularlysophisticated GUIs have been developed for interaction with websites onthe Internet. These GUIs are commonly referred to as web browsers. Via aGUI, a user may enter information, retrieve information, and executecommands. A common user input device for interacting with a GUI is amouse. For example, to execute a command, the user may use a mouse tofirst position a cursor over a virtual function key and then click themouse to execute the command.

Many websites support multiple multimedia tasks: displaying text andgraphics, playing music and videos, sending e-mail, and performinginformation searches are only a few examples. Often, many multimediatasks are grouped together on a single webpage. As the number of virtualfunction keys on a single webpage has increased, the size of virtualfunction keys has correspondingly decreased to avoid consuming a largeportion of display space. Consequently, virtual function keys often haveminimal associated text or no associated text (icons). At the same time,as the variety and complexities of functions supported by a GUI continueto increase, it becomes less clear what function is associated with aspecific virtual function key. A popular solution for clarifyingoperations is to display supplementary information (such as “help”information) providing more details associated with a specific functionkey. In some instances, the user positions the cursor over a region (forexample, marked with a “?”) next to the virtual function key and clicksthe mouse to display help information. In other instances, the usermaintains the cursor in a stationary position over the virtual functionkey and help information is automatically displayed. Typically, the helpinformation is displayed in a help window in the neighborhood around thevirtual function key. Consequently, the primary information in thisneighborhood is blocked. This mode of presentation may be deleterious ifthe help information references the primary information in theneighborhood itself.

A mode of presentation similar to a help window may also be used todisplay supplementary information associated with other informationelements. In one example, a user may position the cursor over thekeyword “indium” in a chemistry article. A display window containing keyphysical parameters (such as melting point) and a synopsis of industrialapplications may automatically open up. In a second example, a user mayposition a cursor over a financial chart. A display window containing anexplanation of the axes of the chart and providing details of theplotted data may open up. In a third example, a user may position thecursor over a specific component in an assembly diagram. A displaywindow containing instructions on how to connect the specific componentto another component may open up. As in the case of a help window,however, the display window blocks the primary information in theneighborhood of the information element of interest. For example, if thedisplay window blocks a portion of the assembly diagram, the user needsto toggle the display window on and off to refer to the assembly diagramwhile reading the assembly instructions. What are needed are method andapparatus for displaying help and other supplementary informationwithout blocking primary information of interest on a GUI.

BRIEF SUMMARY

In an embodiment of the invention, a request for supplementaryinformation is received. The supplementary information is retrieved anddisplayed in a reserved display field in a graphical user interface. Thereserved display field may be configured by a user to adapt to specificapplications, but remains stationary throughout the user session. Thereserved display field does not obstruct any other display fields in thegraphical user interface. A request for supplementary information may begenerated by using a mouse to first position a cursor over an activedisplay element. A request for supplementary information associated withthe active display element may be generated by clicking the mouse, or byholding the cursor stationary for a time interval greater than athreshold dwell time.

These and other advantages of the invention will be apparent to those ofordinary skill in the art by reference to the following detaileddescription and the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a schematic of a webpage displayed on a video display;

FIG. 2 shows examples of processes for displaying supplementaryinformation in a display window;

FIG. 3 shows a first example of a display window obstructing primaryinformation;

FIG. 4 shows a second example of a display window obstructing primaryinformation;

FIG. 5 shows an example of displaying help information, according to anembodiment of the invention;

FIG. 6 shows an example of displaying supplementary information,according to an embodiment of the information;

FIG. 7 shows a flowchart of steps for displaying supplementaryinformation, according to an embodiment of the invention; and

FIG. 8 shows a high-level schematic of a computer.

DETAILED DESCRIPTION

FIG. 1 is a high-level schematic of a webpage 102 displayed on a displaysuch as a computer monitor. Represented are examples of various displayfields. Display field 108 contains virtual function key 108A-virtualfunction key 108E, which are labeled with some associated text. Somevirtual function keys, such as virtual function key 108A (“SAVE”) andvirtual function key 108B (“SEARCH”), have acquired some degree ofuniversal meaning, although the details of the operation are stillapplication specific (for example, SAVE what to where?). Display field110 contains icon 110A-icon 110E, which are devoid of associated text.Again, although some icons have acquired some degree of universalmeaning, the details of the operation represented by an icon aretypically highly application specific. Display field 112 is a displayfield in which multimedia content 112A (such as audiovisualpresentations) may be played. Display field 114 contains virtual controlkey 114A-virtual control key 114C for operating a video player. Displayfield 106 displays text elements. Text element 106A-text element 106Hare representative text elements. Lastly, display field 104 containsstill image 104A.

Herein, all the information elements displayed on webpage 102 arereferred to as display elements. Display elements include all theinformation elements in display field 104-display field 114. Herein, anactive display element refers to a display element which has associatedsupplementary information. As discussed above, supplementary informationmay refer to help information associated with virtual function key 108A,icon 110B, and virtual control key 114C. Supplementary information mayrefer to explanatory or more detailed information associated withmultimedia content 112A playing in display field 112 and still image104A shown in display field 104. Supplementary information may also beassociated with active text elements in display field 106. Text element106B and text element 106G, indicated by black bars, are representativeactive text elements. For example, if active text element 106B is thename of a singer, supplementary information may include a discography.As another example, if active text element 106G is the name of acompany, supplementary information may include a graph of its stockprice over the past month. Supplementary information is commonlyprovided as text. In general, as used herein, supplementary informationmay be presented in any mode, including text, drawings, graphs, stillimages, and audiovisual presentations. Herein, audiovisual presentationsinclude presentations with audio only (with a background display, forexample), presentations with video only, and presentations with acombination of audio and video.

Also shown in FIG. 1 is cursor 101. The position of cursor 101 may bemoved by a user via a user input device such as a mouse. The user inputdevice may also be used to transmit a control signal to execute afunction associated with a virtual function key, such as virtualfunction key 108C. This operation is commonly referred to as clickingthe mouse. In the embodiments of the invention discussed below, a mouseis used as an example of a user input device which a user may use toposition a cursor on a display and which a user may use to transmit acontrol signal to execute a command. Other examples of user inputdevices include keyboards, digitizing tablets, and joysticks.

FIG. 2 illustrates prior-art schemes for displaying supplementaryinformation. Shown in initial display sequence 220 are cursor 101 andactive display element 212. The grids in neighboring display field 210represent the display field in a neighborhood around active displayelement 212. In one scheme, the user moves the cursor over activedisplay element 212 (via operation 211). The results are shown indisplay sequence 240. Cursor 101 has changed from a default shape(typically an arrow) indicating position to a different shape (typicallya hand, as in cursor 201) indicating selection of an active displayelement. The active display element is commonly highlighted when it hasbeen selected. For example, if the active display element is an activetext element, the text may be highlighted by color font, bold font, orunderlined font (or combinations of color, bold, and underline). Theuser then clicks on the selected active display element 212 (viaoperation 213). The results are shown in display sequence 250. Asupplementary display window 202, such as a help window, has opened up.The circles within supplementary display field 202 represent thesupplementary information 202A. In all the examples discussed below,circles represent supplementary information. Note that supplementarydisplay window 202 blocks a portion of neighboring display field 210.

In a second scheme, the user may display supplementary informationwithout explicitly clicking the mouse. Starting with the initial displaysequence 220, the user moves the cursor over the active display element212 and holds the cursor 201 stationary for a time interval exceeding athreshold dwell time (via operation 215). Supplementary display window204, containing supplementary information 204A, then automatically opensup. Note that supplementary display window 204 blocks a portion ofneighboring display field 210.

FIG. 3 and FIG. 4 illustrate some disadvantages of the prior-art displayschemes. In FIG. 3, icon 110E has been selected by cursor 201. Thesupplementary display window 302, containing supplementary information302A, blocks a portion of display field 110 and display field 112. InFIG. 4, active display element 106B (which is an active text element)has been selected by cursor 201. The supplementary display window 402,containing supplementary information 402A, blocks a portion of displayfield 106.

FIG. 5 and FIG. 6 illustrate displays of supplementary informationaccording to embodiments of the invention. In FIG. 5, reserved displayfield 504 is reserved for display of supplementary information. Virtualfunction key 502 permits the user to turn on or off the display ofsupplementary information 504A. The position, size, and shape ofreserved display field 504 are initially configurable by the user toadapt to a specific application. In this example, reserved display field504 has been configured to display brief help text. The reserved displayfield 504 then remains static during the user session. Reserved displayfield 504 does not impinge upon any other display field, such as displayfield 104-display field 114, on webpage 102. In FIG. 5, icon 110E hasbeen selected by cursor 201. Help information associated with icon 110Eis displayed as supplementary information 504A in reserved display field504. Display field 104-display field 114 remain unobstructed.

In the embodiment shown in FIG. 6, reserved display field 604 has beenconfigured to display a wider range of supplementary information 604A,which may include, for example, text, drawings, graphs, still images,and audiovisual presentations. Virtual function key 602 permits the userto turn on and off display of supplementary information 604A. In FIG. 6,active text element 106B has been selected by cursor 201. Supplementaryinformation associated with active text element 106B is displayed assupplementary information 604A in reserved display field 604. Displayfield 104-display field 114 remain unobstructed.

FIG. 7 shows a flowchart of steps for displaying supplementaryinformation, according to embodiments of the invention. In step 704, arequest for supplementary information 702 is received by a supplementaryinformation processing module for retrieving and displayingsupplementary information. The request for supplementary information maybe generated by a user using a mouse to first select an active displayelement (such as icon 110E in FIG. 5 or active text element 106B in FIG.6) by moving a cursor (such as cursor 201 in FIG. 5 and FIG. 6) over theactive display element. In one embodiment, the user then generates therequest by clicking on the mouse. In another embodiment, the user thengenerates the request by holding the cursor stationary for a timeinterval exceeding a threshold dwell time. The threshold dwell time is aparameter which may be configured in a program controlling operations ofthe mouse. The act of clicking on the mouse or the act of holding thecursor stationary generates a control signal which initiates executionof a command to generate the request. The process then passes to step706, in which the supplementary information processing module processesthe request and retrieves the supplementary information. The processthen passes to step 708, in which the supplementary informationprocessing module outputs the requested supplementary information. Theoutput 710 of the process is the display of the supplementaryinformation (such as supplementary information 504A in FIG. 5 andsupplementary information 604A in FIG. 6) in a reserved display field(such as reserved display field 504 in FIG. 5 and reserved display field604 in FIG. 6).

One skilled in the art may develop and apply an embodiment of theinvention to standalone applications with a graphical user interface.For example, computer-based training sessions (such as coursework) andcomputer-based reference works (such as an encyclopedia) may be loadedonto a standalone personal computer. Presentation of information mayinclude active display elements with associated supplementaryinformation.

One embodiment of a supplementary information processing module may beimplemented using a computer. The steps shown in the flowchart in FIG. 7may be executed using a computer. As shown in FIG. 8, computer 802 maybe any type of well-known computer comprising a central processing unit(CPU) 804, memory 808, data storage 806, and user input/output interface812. Data storage 806 may comprise a hard drive or non-volatile memory.User input/output interface 812 may comprise a connection to a mouse820, a keyboard 822, or other input device 824, such as a digitizingtablet or joystick. As is well known, a computer operates under controlof computer software which defines the overall operation of the computerand applications. CPU 804 controls the overall operation of the computerand applications by executing computer program instructions which definethe overall operation and applications. The computer programinstructions may be stored in data storage 806 and loaded into memory808 when execution of the program instructions is desired. Computer 802may further comprise a video display interface 810, which may transformsignals from CPU 804 to signals which may drive video display 818. Videodisplay 818 may display webpage 102, cursor 101, reserved display field504, and supplementary information 504A. Computer 802 may furthercomprise one or more network interfaces. For example, computer 802 mayaccess web server 828 via communications network interface 816 andcommunications network 826. Computers are well known in the art and willnot be described in detail herein.

The foregoing Detailed Description is to be understood as being in everyrespect illustrative and exemplary, but not restrictive, and the scopeof the invention disclosed herein is not to be determined from theDetailed Description, but rather from the claims as interpretedaccording to the full breadth permitted by the patent laws. It is to beunderstood that the embodiments shown and described herein are onlyillustrative of the principles of the present invention and that variousmodifications may be implemented by those skilled in the art withoutdeparting from the scope and spirit of the invention. Those skilled inthe art could implement various other feature combinations withoutdeparting from the scope and spirit of the invention.

1. A method comprising: receiving a request to activate a reserveddisplay field, wherein the reserved display field is reserved forpresenting supplementary information associated with a display element;determining a location on a webpage for presenting the reserved displayfield, wherein the location does not impinge upon the display elementpresented on the webpage; configuring a size and a shape of the reserveddisplay field to adapt the reserved display field to a specificapplication; and displaying the reserved display field such that thereserved display field remains stationary at the location on thewebpage.
 2. The method of claim 1, further comprising: presenting thesupplementary information on the webpage, within the reserved displayfield such that the display element and the reserved display fieldremain unobstructed on the webpage.
 3. The method of claim 2, whereinthe presenting the supplementary information is in response to theposition of a cursor remaining stationary for a time interval exceedinga threshold dwell time.
 4. The method of claim 3, further comprising:receiving a position of the cursor, wherein the position of the cursoris located over the display element.
 5. The method of claim 4, furthercomprising: positioning the cursor over the display element in responseto a motion of a mouse.
 6. The method of claim 2, further comprising:receiving a request for supplementary information associated with thedisplay element presented on the webpage.
 7. The method of claim 2,further comprising: receiving user input, via a virtual function key, toturn off and turn on display of the supplementary information presentedwithin the reserved display field.
 8. An apparatus comprising: aprocessor; and a memory to store computer program instructions, thecomputer program instructions when executed on the processor cause theprocessor to perform operations comprising: receiving a request toactivate a reserved display field, wherein the reserved display field isreserved for presenting supplementary information associated with adisplay element; determining a location on a webpage for presenting thereserved display field, wherein the location does not impinge upon thedisplay element presented on the webpage; configuring a size and a shapeof the reserved display field to adapt the reserved display field to aspecific application; and displaying the reserved display field suchthat the reserved display field remains stationary at the location onthe webpage.
 9. The apparatus of claim 8, the operations furthercomprising: presenting the supplementary information on the webpage,within the reserved display field such that the display element and thereserved display field remain unobstructed on the webpage.
 10. Theapparatus of claim 9, wherein the presenting the supplementaryinformation is in response to the position of a cursor remainingstationary for a time interval exceeding a threshold dwell time.
 11. Theapparatus of claim 10, the operations further comprising: receiving aposition of the cursor, wherein the position of the cursor is locatedover the display element.
 12. The apparatus of claim 11, the operationsfurther comprising: positioning the cursor over the display element inresponse to a motion of a mouse.
 13. The apparatus of claim 9, theoperations further comprising: receiving a request for supplementaryinformation associated with the display element presented on thewebpage.
 14. The apparatus of claim 9, the operations furthercomprising: receiving user input, via a virtual function key, to turnoff and turn on display of the supplementary information presentedwithin the reserved display field.
 15. A computer readable mediumstoring computer program instructions, which, when executed on aprocessor, cause the processor to perform operations comprising:receiving a request to activate a reserved display field, wherein thereserved display field is reserved for presenting supplementaryinformation associated with a display element; determining a location ona webpage for presenting the reserved display field, wherein thelocation does not impinge upon the display element presented on thewebpage; configuring a size and a shape of the reserved display field toadapt the reserved display field to a specific application; anddisplaying the reserved display field such that the reserved displayfield remains stationary at the location on the webpage.
 16. Thecomputer readable medium of claim 15, the operations further comprising:presenting the supplementary information on the webpage, within thereserved display field such that the display element and the reserveddisplay field remain unobstructed on the webpage.
 17. The computerreadable medium of claim 16, wherein the presenting the supplementaryinformation is in response to the position of a cursor remainingstationary for a time interval exceeding a threshold dwell time.
 18. Thecomputer readable medium of claim 17, the operations further comprising:receiving a position of the cursor, wherein the position of the cursoris located over the display element.
 19. The computer readable medium ofclaim 18, the operations further comprising: positioning the cursor overthe display element in response to a motion of a mouse.
 20. The computerreadable medium of claim 16, the operations further comprising:receiving a request for supplementary information associated with thedisplay element presented on the webpage.